Papers with unsupervised bilingual lexicon induction
Multi-Adversarial Learning for Cross-Lingual Word Embeddings (2021.naacl-main)
Copied to clipboard
| Challenge: | Generative adversarial networks (GANs) have succeeded in inducing cross-lingual word embeddings without supervision, but their performance for distant languages is still not satisfactory. |
| Approach: | They propose a multi-adversarial method that induces the seed cross-lingual dictionary through multiple mappings, each induced to fit the mapping for one subspace. |
| Outcome: | The proposed method improves performance on bilingual lexicon induction and cross-lingual document classification on unsupervised bilingual linguistic induction. |
Domain Mismatch Doesn’t Always Prevent Cross-lingual Transfer Learning (2022.lrec-1)
Copied to clipboard
| Challenge: | Recent studies have reported that domain mismatch prevents cross-lingual transfer . UBLI and UNMT do not work well when underlying monolingual corpora come from different domains . |
| Approach: | They show that a simple initialization regimen can overcome domain mismatch in cross-lingual transfer . they pre-train word embeddings on concatenated domain-mismatched corpora and use them as initializations . |
| Outcome: | The initialization regimen can overcome the domain mismatch effect in cross-lingual transfer learning . the initializations were used for MUSE UBLI, UN Parallel UNMT, and the SemEval 2017 task . |
MAAM: A Morphology-Aware Alignment Model for Unsupervised Bilingual Lexicon Induction (P19-1)
Copied to clipboard
| Challenge: | Existing work shows that morphological variation is an intractable challenge for the unsupervised bilingual lexicon induction task. |
| Approach: | They propose a morphology-aware alignment model to alleviate the adverse effect of morphological variation by introducing grammatical information learned by the pre-trained denoising language model. |
| Outcome: | The proposed model outperforms state-of-the-art unsupervised systems and achieves competitive performance compared to supervised methods. |
Improving Zero-Shot Cross-lingual Transfer for Multilingual Question Answering over Knowledge Graph (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to solve multilingual question answering over knowledge graph (KGQA) use of bilingual lexicon induction to map training questions into those in target language circumvents language inconsistency . |
| Approach: | They propose to use bilingual lexicon induction to map training questions in source and target languages as augmented training data to minimize syntax-disorder. |
| Outcome: | The proposed model narrows the gap in zero-shot cross-lingual transfer between source and target languages. |
When Your Cousin Has the Right Connections: Unsupervised Bilingual Lexicon Induction for Related Data-Imbalanced Languages (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for unsupervised bilingual lexicon induction depend on good quality static or contextual embeddings for both languages. |
| Approach: | They propose a method for unsupervised bilingual lexicon induction between a related LRL and a high-resource language that only requires inference on a masked language model of the HRL. |
| Outcome: | The proposed method performs well on low-resource languages with 5M tokens against Hindi . it is compared with existing methods on (mid-resourced) Marathi and Nepali . |